Combine Approach for Speech and Gesture Recognition
نویسندگان
چکیده
Gesture and Speech based human Computer interaction is attractive attention across various areas such as pattern recognition, computer vision. Thus kind of research areas find many kind of application in Multimodal HCI, Robotics control, Sign language recognition. This paper presents head and hand Gesture as well as Speech recognition system for human computer interaction (HCI).This kind of vision based system can show the capability of
منابع مشابه
Model-based Animation of Coverbal Gesture
Virtual conversational agents are supposed to combine speech with nonverbal modalities for intelligible and believeable utterances. However, the automatic synthesis of coverbal gestures still struggles with several problems like naturalness in procedurally generated animations, flexibility in pre-defined movements, and synchronization with speech. In this paper, we focus on generating complex m...
متن کاملGesture and Speech for Video Content Navigation
This article describes ongoing research in the use computer vision gesture and speech recognition techniques as a natural interface for video content navigation, and the design of a navigation and browsing system that caters to these natural means of computer-human interaction. For consumer applications, video content navigation presents two challenges: (1) how to parse and summarize multiple v...
متن کاملFusion of children's speech and 2D gestures when conversing with 3D characters
Most existing multi-modal prototypes enabling users to combine 2D gestures and speech input are task-oriented. They help adult users solve particular information tasks often in 2D standard Graphical User Interfaces. This paper describes the NICE Andersen system, which aims at demonstrating multi-modal conversation between humans and embodied historical and literary characters. The target users ...
متن کاملCoexpressivity of speech and gesture: Lessons for models for aligned speech and gesture production
When people combine language and gesture to convey their intended information, both modalities are characterized by an intriguing degree of coherence and consistency. For developing an account how speech and gesture are aligned to each other, one question of major importance is how meaning is distributed across the two channels. In this paper, we start from recent empirical findings indicating ...
متن کاملCombining SVG and models of interaction to build graphically rich user experiences
IntuiLab designs highly interactive UIs that often feature multimodal capacities: gesture recognition, speech recognition, etc. We have started to use SVG for the graphical modality at the core of our UI programming environment: IntuiKit. Our portfolio includes UIs with high−end graphics for Air−Traffic control centers, in−car systems and for e−government services. Using SVG has lead us to impr...
متن کامل